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ABSTRACT 



In February 1968, the Social Studies Implementation 
Project began as a cooperative venture involving twenty- tjhree school 
districts in metropolitan St. Louis. The overall objective of the 
project was to operate a model which was designed to overcome the 
problems -of curriculum implementation. Operationally, the project had 
several objectives; 1) to create four field stations; 2) to carry out 
a three-year four-stage implementation process in each field station: 
analysis and selection of curricula; strategy and lesson development 
requiring the utilization of new curriculum; field testing new 
materials a field station school; and, diffusion of the materials 

from the field school to radial schools; 3) to produce a group of 
teachers wtvo have mastered and accepted this implementation process; 
4) to alter patterns of school curriculum decision making by placing 
project personnel in key role or encouraging adoption;- and, 5) 
disseminate the curricula. They developed a six-phas^ evaluation of 
the model akin to a field study including bof^ e and 

sumrivative evaluation. The sources of d'ata wer observer notes, 

progress reports, data from participants, third-party reports from 
studies of the project by graduate ^students,™ and interviews of 
participant teachers. Three formal data collection instruments were 
used: a measure of role strain, semantic differential, and a measure 

of decision making criteria. The only positive outcomes werer, 
acceptance of the model, the development of curriculum analysis 
skills, and the dissemination of the materials. (Author/SBE) 
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Foreword 



During the period 1966 - 1970 ' metropolitan St. Louis was the site of a unique 
project designed to foster the rational implementation of new social studies 
curricula. This project involved many local school districts, the Elementary and 
Secondary Education Act of 1965 (Titles III and IV), the Educational Council for 
Responsible Citizenship, and the Metropolitan St. Louis Social Studies Center 
located at Washington University, 

The following report was prepaid by the Center for Educational Field Studies 
at Washington University, The Cen__r has previously provided formative evaluation 
data for the Project staff. The present report is summative; it is primarily 
intended for those who wish to judge the overall effectiveness of the Project and 
for those who wish to learn about the characteristics, the successes, and the 
failures of curriculum implementation. 

Because we have been 'particularly concerned with identifying and analyzing 
the Project f s weaknesses, in order that others might learn from them, a dispropor- 
tionate amount of space in the accompanying report is devoted to negative aspects 
of the Project . S*e hope no one is misled by this emphasis, for we think the 
Project has enormous promise. The Project was significant on many counts. First, 
during the pre-operat ional planning phase and throughout the Project f s life, key 
individuals have been unusually rational in their approach to the Project, From 

the very beginning there were intensive efforts t'* clearly y ^ v1 e '^ s 

j s' 

that were to be solved, to generate and to consider several solutions, and to 

review the consequences of the solutions which were adopted. The fact th^t the 

Project devoted an exceptionally high proportion of its limited resources to 

evaluation is one measure of the Project's interest in rationality; the eagerness 

of participants to receive evaluative data, and to act upon them, is another. Tn 

an era when rationality is too often discounted, and in the face of we educators' 

hab.it of preaching but- not practicing rationality, it is reassuring to observe 

/ \ 

its workings and to acknowledge its beneficent outcomes. (The Project also demon- 
strated the limits of rationality-- the unforeseen event, the lack of essential 



- 2 - 



infocmation, and the importance of intuition, perseverance, enthusiasm, and 
happy circumstance*) Second, the Project demonstrated that it is possible 
albeit difficult, to bring together and to coordinate the resources of several 
local school districts, state and national education agencies, and a major 
university; such coordinated efforts will be increasingly important as educators 
attempt to grapple with the massive problems coif ront ing today’s schools. Third, 
and most important, the Project was largely successful in attaining its goals. 

In essence, these goals were to drastically shorten the usually lengthy period of 
time required fo*- innovative materials to reach large numbers of classrooms, to 
ensure that the new materials were nonetheless taught as intended, and to create 
a corps of teachers capable of directing continued implementation activities upon 
cessation of the Project. These goals are highly germane to the future viability 
of American schools. Hopefully this report will encourage and facilitate future 
efforts to achieve such goals. 

Many people helped prepare this report* Ruth Wessler and Patricia Keith 
^directed the evaluation during 1968-69 and. 1969-70, respectively. F. J. firown, 
William Gussner, Newton Siegal, and Albert Wolfiugton helped with data collection 
and made preliminary data analyses, Thomas Johnson provided help in processing 
the data reported in Chapter V. Jimmy Applegate, Jn- AT **rt Peeler, 

Elliot Seif, Ted ^ta^r^din, Jean Young studied the Project from various 

perspectives, and generously shared their reports with us. We fj.ipnsetf a great 
deal unon ~he central staff and the field station personnel whe involved in 

the fro jeer. We cannot acknowledge these people individually, ^ut we can report 
that tmey were unfailingly cooperative in letting us observe their activities and 
in answering our questions. 

Responsibility foir the content of this report rests with 




David L. Colcon, Director 
Center for Educational r^ie.ld Studies 
Washington University 
November, 1970 

- 4 , . 
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Chapter I 

THE SOCIAL STUDIES IMPLEMENTATION PROJECT 
OVERVIEW AND BACKGROUND 

The Social Studies Implementation Project is a cooperative venture involving 
twenty-three school districts in metropolitan St. Louis, the Metropolitan Social 
Studies Center at Washington University, the Central Midwestern Regional Educational 
Laboratory, Inc. (CEMREL) , the United States Office of Education, and the Missouri 
State Department of Education. Since 1964 these agencies have created and operated 
a project designed to train teachers in effective techniqv.es of curriculum implemen- 
tation in the social studies, and to disseminate new social studies curricula in the 

/ 

/ 

St. Louis metropolitan area. 

/ 

/ 

/ Design 

The design of the Implementation Project was developed during the period 
1964-b6, when the St. Louis Educational Council for Responsible Citizenship and 
Washington University, supported in part by a grant from the U. S. Office of Educa- 
tion, engaged in an intensive study of the problems ot implementing new social 
studies curricula in the metropolitan area. Despite the existence of a multitude 
of social studies curriculum development projects around the country, and despite 
educators 1 recognition of the need for social studies curriculum reform, the pros- 
pects for change in social studies classes seemed bleak. Several factors appeared 
to limit the prospects for rapid or wide-scale adoption of new social studies 
curricula. First, the national curriculum projects seldom included any plans or 
any funds for installing the new curricula in the nation’s schools. Second, many 
of the national curriculum projects were producing supplemental instructional 
materials rather than whole new courses; this created the danger that social 
studies courses would lose whatever intelectual coherence and integrity that they 
had, and become mere collections of interesting materials. A third reason for 
pessimism about the adoption of new social studies curricula stemmed from the 
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fact that the curriculum projects were not producing two vital types of information 
that would be needed by local curriculum decision-makers: (1) the projects were 

nut producing clear and detailed descriptions of curriculum goals, nor of the 
rationale underlying the choice of goals; and (2) projects were not providing 
evaluation data which would allow local decision-makers to determine whether the 
new materials were effective in accomplishing their goals. In addition to the 
problems inherent in the curriculum projects, there were problems at the local 
level among the prospective adopters of new curricula. Local school curriculum 
revisions usually were the responsibility of teacher committees which were charged 
with the task of producing syllabi which included bibliographies, textbook recom- 
mendations, and lists of suggested activities. While such committees often had 
the best intentions in the world, and sometimes accomplished something worthwhile, 
they hadn’t the time, the resources, or the training to 'ensure that changes were 
more than superficial. Another problem at the local level was the lack of expert© 
who could provide systematic and long-term help to local curriculum committees. 
University consultants were few in number, and their services were usually mono- 
polized by the more affluent schools. Even when a district employed its own 
curriculum specialists, they were often burdened by administrative chores or out 
of touch with the most recent developments in their field. Teachers, on their 
own, could hardly be expected to grasp the initiative in curriculum reform; their 
time was too limited, their access to developments around the nation was too 
restricted, and their opportunities for systematic collegial work with their peers 
were virtually nonexistent. Thus there were a multitude of problems which made 
it seem unlikely that the new curriculum projects in social studies would have ^ 
much impact upon Americans classrooms.^ 

^ The Development of a Model for the Metropolitan St. Louis Social Studies 
Center, Final keport, Project Z-004 (Office of Education, February, 1967). 
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In order to overcome these problems, an interschool agency known as a field 

i 

station was proposed. A field station would consist of two representatives from 
each of 5-7 schools, plus a central staff (see Figure 1). The teachers in the 
field station were to be given reduced teaching loads so that they could meet 
regularly with the Project staff to (1) analyze and select new social studies 
curricula, (2) develop strategies and lessons which would be required to utilize 
the new curricula, (3) try the new materials on a pilot basis in the 11 field school" 
and (4) diffuse the materials from the field school in each station to the M radial 
schools'* in each station. This four-phase process would be carried out over a 
three-year period for any specified grade level (see Figure 2). At the conclusion 
of the field station implementat ion cycle, it was anticipated that limited diffu- 



sion of new curricula would have occurred, and that the teachers who had partici- 
pated in the implementation process would be sufficiently trained to establish 
comparable implementation programs within their own districts. 
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Figure 1 

STRUCTURE OF ONE FIELD STATION 
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Figure 2 

PHASES OF EACH FIELD STATION 
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Ob lectives 







The overall objective of the Implementation Project was to operate a model 
which was designed to overcome the problems of curriculum implementation in the 
area of social studies. -Operationally, the Pro ject.had several objectives: 

1. to create four field stations; ■' 

2, to carry out a four- stage implementation process (analysis, development, 
pilot, and diffusion), in each field station; and 

■ 3.. through #l_and,#2 , to (a) produce a group of teachers who have mastered 

and accepted the particulars of the implementation process, (b) alter 
established patterns of school curriculum decision making by placing 



• . > v 

project personnel in key curriculum roles and/or by encouraging adoption 

of the Implementation process by others, and (c) disseminate new social. 

studies curricula in metropolitan St. Louis. 

* * * % / • 4 , 

A fourth objective, which provides^ 'the justification for this evaluation report, 
was to assess the effectiveness of the implementation model so that others might 

have a basis for adopting, modifying., or re jecting * it . • 

i , ' 7 ' • , • 

’ Brief ^History of the Project 

One field station was put into operation on a limited basis in September, i966, 
with support from cooperating districts, from CEMREL, and from Washington University, 

■’ » 1 o 

In the ensuing months there were repeated efforts to obtain federal support under 

■ ' ■ . r *'■ . • 

Title III 1 ' of ESEA; these efforts finally came to fruition in February, 1968, when 
the USOE entered into a 'contract with the Ladue School District , which was acting 
on behalf of virtually all districts in the St, Louis metropolitan area- Title III 
funds, permitted the continuation of the initial field station, immediate creation 
of two additional stations, and creation of a fourth station in January , 1969/ 

4&7ith the exceptions rioted elsewhere in this report, the field stations adhered to 
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Chapter II 

EVALUATION DESIGN AND PROCEDURES 

To an extent that is unusual among Title III Projects, the Implementation 

! 

Project, from its inception, has-been seriously concerned with the evaluation 
process. The nature of this concern, and th^manne^r of its implementation, are 
described in this section. 

Original Expectations about Evaluation 
The original „ prospectus for the Implementation Project included an elaborate 
rationale artd plan for ev^l^aticm. Two general typeB of evaluation were antici- 
pated Internal evalu.it lea n .to_b_e_ conducte d largely by the fie ld station mem- 

bers themselves, with the assistance of a measurement specialist. It was to be 

\ * 

oriented to the question: does^ a specific curriculum achieve whpt it purports to 

^achieve? External evaluation was to be conducted largely by the Project’s central 
staff, whose task was to examine the Project’s effects upon teachers’ curriculum 

4 * 

analysis skills and attitudes and upoi| the institutional settings in which curri- 
culum imp lamentation occurred (or did not occur) . In connection with the latter 
problem^an elaborate system for the stratification of school^, and for the identi- 
fication of factors affecting adoption, was proposed; this system was supposed to 
facilitate extrapolation of Project findings to other schools and school systems. 1 

There were a number of flaws in the original plans for evaluation. Among them 

* „* *■ ’' 4 ~ ( 

were thebe: (1) .The plans were very incomplete. For example, techniques for iden- 

tifying or measuring changes in teachers were not specified. Linkages among the 
several phases and elements of the Project, and the implications of these linkages 
for the overall success of the Project, were ignored. (2) The plan for identifying 



i 



^-Project Proposal (Title IIP), June, 1967, pp, 76 - 84 . 
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factors affecting school system innovativeness was sophisticated but quite inappro- 

i ’ 

priate for this Project. For example, the plan assumed that the school district 

j _ . . - 

was the adopting unit, whereas the project itself viewed the teacher ^ the classroom 
and the school building as the target populations. Worse, the plan concentrated on 
variables which were quite beyond the control of the Project. (3) The difficulty 
of finding and obtaining evaluation personnel was drastically underestimated. 

(4) The original planning, quite naturally, not anticipate the ferment in the 

field of evaluation that blossomed in the Late '2960* & ; this ferment had soms* impor- 
tant implications for the actual conduct of .sr -evaluation. 



Revised Schedule for Evaluation 



From September, 1966, until January, 19*68,, che — sjources available to the 
Implementation Project were severely limited 1 * Ixistnmg resources were concentrated 
on the development of the initial field station; no rse s ources were available for 
evaluation^ When Title III/ funds became available in January, 1968, the timing 
was such that neither a permanent Project Director nor an evaluation staff could 



be found 1 immediately; again, available resources were used for Project operation. 



/ , . 

By late spring', 1968, three field stations were in operation, but still no evalua- 
tion staff had been identified. As a result, no base-line data was collected. 

V ! ■ 

\ In May, 1968, Washington University's Center for Educational Field Studies 

| , 

(CEFS) proposed to the Title III Board of Directors that the CEFS design and 
conduct the external evaluation.^ The proposal included a six-phase plan of 
operation: j 

1. Familiarization- -(6/15/68- 10/15-68) In this phase the CEFS evaluation 

i ' “ 

staff was to acquaint itself with the Project’s background, rationale, 



staff 



, and ope 



2 . 



rations. 
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Formulation of Ob jectives-- (5/15/68-12/1/68) The evaluation staff was 
to work with i the Project staff to identify and agree upon the actual 
Project objectives. 
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\ 

\ : 

3- Design and Instrumentation-- (10/15/68- 12/31/68) In this phase the 
evaluation staff was to formulate the actual procedures to be used 



in the collection and analysis 



\>f 



data. 



D 



4. Data Collection- - (10/15/68-10/15/70) ^ 

5. Data Analysis- -(Continuous) 

6. Reporting- '’Vo types of reporting activities were proposed. First, the 
evaluation staff would under tak^ to provide fc ^native evaluation, i.e. 
data which could be used by the Project staff t - overcome weaknesses as 
they became apparent. In addition, the staff agreed to prepare a suiranat ive 
evaluation, i.e. a final report which could be nased by other agencies 
interested in adopting the Implementation Project design or procedures. 



o 
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The proposal as outlined above was approved by the Title III Board of Directors 
and subsequently was formalized in agreements among Washington University, the 
Title III Board, and CEMREL (which participated centrally in funding the evaluation). 



The above schedule was closely followed by the evaluation staff. During the 

/ - 

j - 

period from June, 1968, through June, 1970, field observers were employed to 

j • . 

describe the activities of the Implementation Project. Late in 1968 a preliminary 
design for evaluation was formalized. During the period from January, 1969, through 
May, 1970, the evaluation staff collected questionnaire and interview data from Pro- 
ject participants. Periodic feedback was provided to the Project staff, particularly 
during 1968-69. This final report, prepared during the summer of 1970, is summative 
in the sense that it is concerned with the successes and failures of the Project to 
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Revised Evaluation Stratjergj 
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Largely because of the flaws cited above, the evaluation staff rejected ^the 

evaluation plan outlined in the initial Title III proposal. Instead, the staff 

. • * 

adopted a plan more akin to a field study. Such a strategy seemed more suited to 

the late inception of the evaluation effort, to the character of the Implementation 
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